Theoretical Evaluation of Estimation Methods for Data-Oriented Parsing
نویسنده
چکیده
We analyze estimation methods for DataOriented Parsing, as well as the theoretical criteria used to evaluate them. We show that all current estimation methods are inconsistent in the “weight-distribution test”, and argue that these results force us to rethink both the methods proposed and the criteria used.
منابع مشابه
The DOP Estimation Method Is Biased and Inconsistent
A data-oriented parsing or DOP model for statistical parsing associates fragments of linguistic representations with numerical weights, where these weights are estimated by normalizing the empirical frequency of each fragment in a training corpus (see Bod [1998] and references cited therein). This note observes that this estimation method is biased and inconsistent; that is, the estimated distr...
متن کاملBack-off as Parameter Estimation for DOP models
Data-Oriented Parsing (DOP) is a probabilistic performance approach to parsing natural language. Several DOP models have been proposed since it was introduced by Scha (1990), achieving promising results. One important feature of these models is the probability estimation procedure. Two major estimators have been put forward: Bod (1993) uses a relative frequency estimator; Bonnema (1999) adds a ...
متن کاملAn improved joint model: POS tagging and dependency parsing
Dependency parsing is a way of syntactic parsing and a natural language that automatically analyzes the dependency structure of sentences, and the input for each sentence creates a dependency graph. Part-Of-Speech (POS) tagging is a prerequisite for dependency parsing. Generally, dependency parsers do the POS tagging task along with dependency parsing in a pipeline mode. Unfortunately, in pipel...
متن کاملProviding a model for educating professional citizens through knowledge-oriented era of Iran's education system
Introduction: This study aimed to provide a model in order to educate professional citizens through knowledge-oriented era of Iran's education system. Methodology: The statistical population of the research consisted of all female and male principals and deputies of governmental elementary schools within cities of Tehran province (N = 11382). The sample size estimated to be 362 people based on ...
متن کاملA Consistent and Efficient Estimator for Data-Oriented Parsing
Given a sequence of samples from an unknown probability distribution, a statistical estimator aims at providing an approximate guess of the distribution by utilizing statistics from the samples. One crucial property of a ‘good’ estimator is that its guess approaches the unknown distribution as the sample sequence grows large. This property is called consistency. This paper concerns estimators f...
متن کامل